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The theory of noncommutative dynamical entropy and 
quantum symbolic dynamics for quantum dynamical systems 
is analised from the point of view of quantum information 
theory. Using a general quantum dynamical system as a 
communication channel one can define different classical ca- 
pacities depending on the character of resources applied for 
encoding and decoding procedures and on the type of infor- 
mation sources. It is shown that for Bernoulli sources the 
entanglement-assisted classical capacity, which is the largest 
one, is bounded from above by the quantum dynamical en- 
tropy defined in terms of operational partitions of unity. 
Stronger results are proved for the particular class of quantum 
dynamical systems - quantum Bernoulli shifts. Different clas- 
sical capacities are exactly computed and the entanglement- 
assisted one is equal to the dynamical entropy in this case. 

03.65.Fd, 89.70.+C 



I. INTRODUCTION 

The relations between the classical theory of dynam- 
ical systems and the theory of classical communication 
channels are given by the Kolmogorov-Sinai construc- 
tion of symbolic dynamics and dynamical entropy (K-S 
entropy) [1]. One can expect that in the quantum do- 
main the interrelations with information theory should 
be much deeper. This is due to the fact that the 
quantum theory is a genuine statistical and operational 
one and the most fundamental process - state prepa- 
ration followed by measurement - possesses non-trivial 
information-theoretical meaning. Indeed, take a tun- 
able device which prepars a quantum system in one of 
the states {ipi,tp2,...ip m } and use another apparatus to 
perform a measurement of the observable with possible 
values {ai, a2, ...a„}. This can be seen as a single op- 
eration of an information channel with possible inputs 
{1,2, ...,m} and outputs {1,2, ...,n}. Quantum theory 
gives statistical predictions about the value of an out- 
put provided an input is given and optimalization of the 
transmitted information is a fundamental physical ques- 
tion. 

In the last decade a considerable progress in the theory 
of quantum communication channels has been achieved 
[2,3]. However, most of the attention was concentrated on 
memoryless noisy channels. They simulate physical sys- 
tems essentially composed of noninteracting subsystems 
(particles) with quantum noise acting independently on 
each of them. As a consequence, features of dynamics of 



the information carrier do not enter manifestly the game. 
In order to investigate more complicated models of com- 
munication channels we use a different setting for send- 
ing classical information via quantum dynamical systems 
proposed in [4] . In particular we expect relations between 
the speed of information transmission through a channel 
and its chaotic properties characterized by quantum gen- 
eralizations of K-S entropy. In this scheme, not a pres- 
ence of noise, but the way the perturbations of an initial 
state of the system propagate determines the efficiency 
of information processing. It is a well known fact used in 
modern control systems (e.g. aviation technology) that 
working in unstable (chaotic) regime is more efficient that 
in a stable one. A similar phenomenon should be visible 
in the quantum domain also. 

In the theory of communication channels we are inter- 
ested in asymptotic results valid in the limit of infinitely 
long messages. Therefore the convenient mathematical 
description involves infinite quantum systems similar to 
systems in thermodynamic limit considered in statistical 
mechanics and quantum field theory. The corresponding 
mathematical formalism is C*-algebraic approach [5]. 



II. QUANTUM DYNAMICAL SYSTEMS IN 
ALGEBRAIC SETTING 

The approach to dynamical systems and dynamical en- 
tropy used here can be found in [6] together with a num- 
ber of concrete examples and references to original papers 
and alternative formalisms. 

We assume that all bounded observables of our system 
generate a C*-algebra A with unit 1. The discrete-time 
(reversible) dynamics is given in terms of an automor- 
phism 8 acting on A. By u> we denote a state on A invari- 
ant with respect to 0. This state describes the reference 
(initial) state of the system, for instance: ground state 
(e.g. vacuum state of the electromagnetic field), thermal 
equilibrium state, nonequilibrium stationary state (e.g. 
stream of particles), etc. The triple [A, Q,cj) will be 
called a quantum dynamical system. For infinite systems 
the C* — algebra A contains elements which do not cor- 
respond to observables measured by any finite apparatus 
but rather describe properly defined limits of physical 
observables. Therefore, it is necessary to consider a sub- 
algebra Aq of physically admisible observables called local 
or smooth subalgebra. The local algebra should be invari- 
ant with respect to dynamics i.e. for A <E Ao, Q(A) € Aq 
too. 
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Ergodic properties of quantum dynamical systems are 
usually defined in terms of system's reaction to external 
perturbations. Any such perturbation can be realised 
by a completely positive unity preserving map A : A i— > 
A. We restrict ourselves to local and finite perturbations 
given by the formula 

k 

a^(a) = J2x;ax 3 (i) 

where X = {X 1 ,X 2 ...,X k ;X j e -4 ; E*=i = 1} is 

an operational partition of unity. 

A completely positive map (1) perturbs the reference 
state oj yielding a new perturbed one which is defined in 
terms of the mean values 

k 

lu*(A) = ^u){X*AX 5 ) , A e A . (2) 
i=i 

One should notice that different partitions can produce 
the same completely positive map. For two partitions 
X,Y we define a finer partition XoY = {XjYi;j — 
1,2, ...,k,l = 1,2, ...,r} and the corresponding com- 
pletely positive map AxoY = AyAx- Both, the set of 
partitions V(Ao) and the set of corresponding completely 
positive maps M.{Aq) form semigroups with respect to 
compositions and with a unity given by a trivial parti- 
tion I = {1}. There are important subsemigroups of 
partitions and maps : 

a) V h (Ao) and M h (Ao) generated by bistochastic par- 
titions i.e. Y!}=i X j X j = 1 

b) V u (Ao) M w {Aq) generated by unitary partitions i.e. 
X*X j =X j X* = N l;j = l,2,...,k. 

Obviously T u (A a ) C V b {A ) C V(A ) and 
M U (A ) C M b (A ) C M(A ). The different subsemi- 
groups correspond to the different means used to per- 
turb our system. Unitary partitions can be realized 
by external classical possibly random "potentials", bis- 
tochastic ones can involve interaction with quantum en- 
vironment at infinite temperature (tracial) state, which 
displays some classical features, while general partitions 
need generic quantum ancillary resources. It is important 
that the bistochastic maps does not decrease the entropy 
of the system. 



c) the state u) is represented by the normalized Hilbert 
space vector |0 >e TL^ such that uj(A) =< il, AVL >, 

d) the dynamical automorphism 9 is represented by 
the unitary operator U , U\Q >— \£l > and for B = 
G(A), B = WMA = 6(i). It is useful to define the 
Schrodinger picture of the dynamics in the Hilbert space 
representation by a transposed map 

Q T {p)=UpU* . (3) 

The Hilbert space TL U can be identified with the al- 
gebra A equipped with the scalar product < A, B > = 
uj(A*B) modulo the equivalence relation: A = B if and 
only if u[(A - B)*(A - B)] = 0. The element defined by 
the unity 1 in A is exactly our normalized vector fi. Any 
element A of the algebra A is represented by the operator 
A which is defined by the left multiplication. Operators 
corresponding to right multiplication form an algebra of 
observables of a " minimal environment" (ancilla) . 

The formalism of above, called in the mathematical 
literature GNS representation, has been rediscovered by 
physicists under the names of the Liouville space ap- 
proach [7], thermofield formalism [8] or in the context 
of quantum information theory as "state purification by 
ancilla" [2]. Its physical meaning for finite systems is 
clear: for a system being in a mixed state we reconstruct 
its minimal dilation described by a pure entangled state 
which reproduces the original state as a reduced marginal 
one. 

Completely positive maps discussed above act in GNS 
representation on the whole operator algebra Biji.^) 

k 

Ax(B) = X *j BX i > B e B ( H ") ( 4 ) 
i=i 

and the perturbed state w x is represented by the density 
matrix 

fe 

p[X] = A X (|Q >< = \ x jtt >< XjSl\ (5) 

where A x is the (GNS) Schrodinger picture version of 
the Heisenberg picture map Ax- 

B. Quantum dynamical entropy 



A. Hilbert space representation 

It is often very convenient to use a canonical represen- 
tation of a dynamical system (A, O, w) in terms of: 

a) the Hilbert space 7i w , 

b) the representation of the algebra A in the algebra 
of bounded operators B(Hoj) i.e. any element A of A 
is represented by an operator A and the map 4 h 4 
preserves the algebraic structure, 



We briefly sketch the theory of quantum dynamical 
entropy defined in terms of operational partitions of 
unity. The basic object in this approach is the following 
multi-time correlation matrix generated by the partition 
X = {Xi, X 2 , X k } 

P[X ]i 1 ,...,i n ;j 1 ,...,j n = 

u ! (x; i Q(x*A..B n -\x*je n -\x in )...@(x i2 )x il ) . 

(6) 
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p[X™] is a positively defined, k n x k n complex-valued 
matrix with a trace equal one. Therefore, the sequence 
{p[X™]; n = 1, 2, 3, ...} can be treated as a consistent fam- 
ily of reduced density matrices which describes the state 
of a one-sided chain of quantum " spins" . To any spin 
at a given site corresponds a fc-dimensional Hilbert space 
and p[X™] is a mixed state of n spins located at the sites 
{0, 1, n— 1}. Then a single step of the evolution trans- 
lates into the right shift on the spin chain and we obtain 
a quantum symbolic dynamics . 

The von Neumann entropy of the density matrix p[X n ] 
measures an amount of information encoded in the mul- 
titime correlations: 

S(p[X"]) = -tr(p[X"]lnp[X"]) (7) 

The entropy of the partition h[u>, 0,X] is defined as a 
limit 

h[u,Q,X\ = limsup-SV[X"]) . (8) 

n^oo n 

Finally, the dynamical entropy of O is a supremum over 
all physically admisible (local) partitions 

h[(j,e,Ao}= sup h[u,G,X] . (9) 

Restricting the supremum to subsemigroups P u (Aq) or 
V b (Ao) we obtain corresponding restricted dynamical en- 
tropics satisfying the obvious inequality 

h u [u>,O,A ] < h b [w,Q,Ao] < h[uj,Q,Ao] . (10) 

The equivalent expression for (8) can be obtained in the 
GNS representation 

S(p[X™]) = S(p[X n }) (11) 

where (see eqs (5) (6)) 

p[x n } = [Q T klr(\n><n\) . (12) 

The formula of above suggests a new interpretation of 
S(p[X. n ]) as the entropy of the density matrix obtained by 
repeated measurements performed on the evolving sys- 
tem + ancilla. 

It has been proved that for classical systems the scheme 
of above reproduces the standard Kolmogorov-Sinai en- 
tropy, and a for a number of infinite quantum systems the 
dynamical entropy (9) has been computed. Moreover, 
in the known examples all three entropies (10) coincide. 
Although, strictly speaking, the dynamical entropy ex- 
ists only for classical or infinite quantum systems the n- 
dependence of the entropy S(p[X™]) provides interesting 
informations about "quantum chaos" in finite quantum 
systems as well. 

There exist other, nonequivalent definitions of quan- 
tum dynamical entropy among them CNT-cntropy is 
the most developed one [9]. Preliminary results on its 
information-theoretical meaning can be found in [10]. 



C. Quantum Bernoulli shifts 

The simplest example of infinite quantum dynamical 
system is a quantum Bernoulli shift. Consider an infinite 
collection of the identical quantum systems (" spins" ) at- 
tached to the sites of 1-dimcnsional lattice labeled by the 
integers Z. The single site algebra is a d x d matrix al- 
gebra and A[_ n _ n ] denotes the algebra localized on 
[— n, n] and given by a suitable tensor product of Mj. 
The local algebra of observables Ao = UneN • / ^[-n,n] carL 
be completed to a C*- algebra A of quasi-local observ- 
ables. The discrete time dynamics 6 is given by a shift 
to the right which is an automorphism on A leaving Ao 
invariant. The state u> of the considered system is a prod- 
uct state <8>zP where p is a single-site state given by a dx d 
density matrix. Obviously, ui is shift invariant. 

One can easily compute the dynamical entropies 
(9) (10) for the quantum Bernoulli shift which are equal 

h u [co,Q,A ] = h b [w,0,Ao\ = h[u,G,Ao] = S(p)+\nd . 

(13) 

To prove it one can notice that the RHS of eq.(13) is an 
upper bound for any h[co, 6,X] , X e V(Ao) due to a 
general inequality 

S{a[X]) < S(a) + \nN (14) 

where a is a density matrix on an N- dimensional Hilbert 
space, X is an arbitrary partition of unity and cr[X]jj = 
tr(aX*Xi). This bound is reached for a local, single-site 
unitary partition 

W = {d- 1 W(k,l);k,l = l,2,...,d} (15) 

where W(k, I) are discrete Weyl operators defined in 
terms of the basis {|e m >;m = 1,2, ...,d} of eigenvec- 
tors of p by the formula 

W(k,l)\e m >= exp(i2nk/d)\e m(B i > , 

m®l = m + l (mod d) . (16) 

III. COMMUNICATION CHANNEL WITH 
CLASSICAL INPUT AND OUTPUT 

We consider a model of communication channel for 
which the input and output are strings of letters and 
the physical carrier of information is a quantum dynam- 
ical system described in the C* -algebraic language by 
(A, Ao, O, w) as in the previous Section. 

A. Input and output 

A given input message of the length n is a sequence 
ai, Q!2, ...a n of letters which belong to a certain alphabet 
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identified with {1, 2, r}. Any letter a is transmitted 
by means of a perturbation of the reference state lo by 
a completely positive map A Q e Ad(Ao). This encod- 
ing procedure will be shortly denoted by A. We can 
restrict possible perturbations to entropy increasing ones 
i.e. A Q e M u (Aq) or A Q E M b (Ao). Two consecutive 
perturbations of the state to are always separated by the 
action of the dynamics 6. This can be regarded as a 
definition of a letter which is the basic unit of the mes- 
sage sent during the single evolution step (unit of time). 
Therefore for a n-letter message we have the correspond- 
ing completely positive perturbation 

a = (ai, a 2 , ■■■ot n ) !— > A Ql 0A Q2 • • • A Qn . (17) 

It is convenient to use the Hilbert space (GNS) rep- 
resentation to associate with a given massage a = 
(oti, a 2 , a density matrix p(a) acting on the Hilbert 

space Huj which can be written using the notation 
(6)(12)(17) as 

p(a) = e T kl n ■ ■ ■ e T kl 2 e T k ai (\n ><n\). (is) 

Receiving of a message is realized by performing 
a measurement of the suitable decoding observable 
D with possible outcomes (Si, S 2 , ■ ■■S m )- Here D = 
{Di,D 2 ,...D m] D k e B(H^),D k > 0,ET=i D k = 1} is a 
generalized observable (or "fuzzy observable"). Choos- 
ing Dk from the whole i?(7Y w ) means that we are able to 
exctract the information encoded in entanglement of the 
system with its environment. If we can perform the mea- 
surements on the dynamical system only we put Dk € A 
identifying any element of A with its operator represen- 
tation in B(Hu)- 

The basic quantity is the conditional output probabil- 
ity P(a\Sj) which gives the probability of recording the 
output Sj under the condition of the input message a [9] 

P(a\Sj) = tr(p(a)Dj) . (19) 

Having a given input probability distribution pi n = 
{Pin(a)} we can define the output probability distribu- 
tion 

Pout(Sj) = Y J p in (a)P(a\S j ) (20) 

a 

and the input-output probability distribution 

Pin,out(a, Sj) = pin(a)P(a\Sj) . (21) 

The standard definition of the amount of transmitted in- 
formation is given in terms of Shannon entropies S(p) = 

-J2Pk^p k [11] 

I(p in , A, D) = S(p m ) + S(p out ) - S{pi, hOUt ) 

= S(p out )-^2p in (a)S(P(a\-)) (22) 

a 



and satisfies the following inequalities 

< /(Pi„, A, D) < mm{S(p in ), S( Pout )} . (23) 

The Holevo-Levitin inequality [11] provides an upper 
bound on I(pi n , A, D) which is independent of the choice 
of an output device 

/(p in ,A,D) < s(^2p in (a)p(a)^ -^2p in (a)S(p(a)) . 

(24) 

B. Channel capacities 

The important quantity which characterizes the effi- 
ciency of a communication channel is its capacity. In 
our case it will be an averaged amount of classical in- 
formation, transmitted per unit of time, maximized over 
definite sets of information sources, encoding and decod- 
ing procedures and calculated in the limit of infinitely 
long input messages 

C= sup {limsup i /(p in , A, D)} . (25) 

{ Pl „},{A},{D} L n^oo n > 

In the following we shall discuss several cases of capacity: 

a) The entanglement-assisted classical capacity Ce [12] 
which corresponds to the suprcmum taken over all in- 
formation sources, arbitrary encoding procedures A C 
M(Aq) and arbitrary decoding observables D C B(H U ) 

b) The ordinary classical capacity C and its rectricted 
versions C u , Cb corresponding to the supremum over all 
information sources, arbitrary decoding observables of 
the system alone, i.e. Dei, and encoding procedures 
involving completely positive perturbations from M(Ao), 
M u (Ao) and M b (Ao) respectively. 

c) The capacities of above restricted to Bernoulli 
sources, i.e. the information sources with product prob- 
ability measures 

Pin(ai,a 2 , a n ) = p(a 1 )p(a 2 )...p(a n ) (26) 

and denoted by C° E , C°, C°, C h °. 

The definitions of above imply obvious inequalities 

C° < C° b < C° < C% , C u < C b < C < C E , 

C E <C E , C° U <C U , C ( > <C b , C° <C . (27) 

The dynamics & of the system is reversible and there- 
fore noise is not explicitly present in this scheme. There 
are several possibilities to introduce noise in our setting. 
The first, natural one, seems to be replacing an autho- 
morphism 6 by a completely positive dynamical map. 
However, this would produce capacities typically equal 
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to zero because the errors accumulate with a number of 
time steps except the situation where a proper scaling of 
noise with n is introduced. Another possibility consists 
in putting extra conditions on decoding observables D, 
assuming that D C B where B is a proper subalgebra 
of A or B(Hu,)- A certain type of background noise ap- 
pears in the case of capacities C u , C\, or C° , C° due to a 
mixed reference state u> which cannot be locally purified 
by entropy increasing perturbations (see Section IV). 

C. Dynamical entropy bound 

We prove our first result which provides the relation 
between ergodic properties of the channel treated as a 
dynamical systems and its entanglement-assisted capac- 
ity for the case of Bernoulli sources. 

Theorem 1 For any quantum dynamical system 

C% < h[uj,Q,A ] . (28) 

The proof follows from the Holevo-Levitin inequality (24) 
and the definitions (8) (9). For a Bernoulli source and a 
given encoding A there exists a partition of unity X such 
that Ax = J2 a P( a )^ a Therefore, for any message of 
length n (see eqs(12)(18)) 

5> n (a)/5(«) = p[X n ] = [e T Al] n (\n >< Sl\) (29) 
and applying (9) (24) 
limsup —I(pin, A, D) < h[iv,e,X\ < h[oj,Q,A ] . (30) 

The natural questions arise, how tight is this bound and 
whether it is possible to prove it for more general sources. 
This will be discussed in the next Section for quantum 
Bernoulli shifts. 

IV. CAPACITIES FOR QUANTUM BERNOULLI 
SHIFTS 

Perturbations of the reference state for quantum 
Bernoulli shifts propagate in a very simple way what al- 
lows to prove much stronger results than those given by 
(27) (28). 

Theorem 2 For a quantum Bernoulli shift the following 
equalities hold 

C° = C b ° = C u = C b = hid - S(p) , (31) 
C° = C = \nd, (32) 
C° E = C E =lnd + S{p) . (33) 



The interpretation of these results is quite obvious. 
The nonzero single-site entropy S(p) can be an obsta- 
cle (noise) or an asset depending on the control we have 
of the system and its environment. Assume first, that we 
have no acces to environment. Then, if we can use en- 
tropy increasing perturbations only, S(p) is an amount of 
noise which reduces the capacity of the channel. Apply- 
ing arbitrary encoding with the help of ancillary resources 
we can reach a capacity In d. 

On the other hand, if we can control the environment, 
represented here as an ancillary spin chain with the prior 
entanglement for any pair spin-ancilla, S(p) becomes an 
amount of entaglement per site which improves the ca- 
pacity. This is exactly the idea of quantum dense coding 
[2]. Moreover, reaches its upper bound (28) and the 
Bernoulli sources are optimal for all studied examples of 
capacities. One can expect that the bound (28) is tight 
and the Bernoulli sources are optimal for a larger class 
of quantum dynamical systems at reference states sat- 
isfying certain clustering properties with respect to dy- 
namics. Finally, one should notice that for the quantum 
Bernoulli shift the CNT-entropy is equal to S(p). 

A. Proof of Theorem 2 

In the first part of the proof we use again Holevo- 
Levitin inequality (24)and the fact that all perturbations 
of the state are strictly local and their propagation is 
given simply by a shift. Hence, for a given encoding A 
all completely positive maps are localised on the sites in 
a certain interval [—1,1]. After n time steps the total 
perturbation is localised in [—1,1 + n] and the perturbed 
state on the quasilocal algebra ® z can be replaced 
by a local density matrix 

p(a) = A T (a)((g> [ _ u+n] p) (34) 

where A T (a) is a total perturbation map in Schrodingcr 
picture (not to be confused with GNS representation 
(18)!). Applying now inequality (24) for the spin system 
living on the interval [— I, I + n] 

I{ Pin ,A,T>) < S(j2p in (a)p(a)} -^p in {a)S(p{a)) 

a a 

(35) 

we obtain for arbitrary perturbations 

J(p in ,A,D) < (n + 2/ + l)lnd (36) 

while for the entropy increasing ones 

J(p in ,A,D) < (n + 2/ + l)(lnd-S(p)) . (37) 

To obtain a bound useful for Ce we use a GNS represen- 
tation and the bound 

J(p in ,A,D) < S(j2p™(a)p(a)) . (38) 
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For any n there exists a partition of unity Y„ which is 
generally not a composition of n partitions like X™ in 
(6) but nevertheless is localised on the interval [—1,1 + n] 
such that 

Y jPin {a)p{a) = p[Y n }. (39) 

a 

Then using (24) and the general bound (14) 



being a purification of p = Ylj=i ^j\ e j >< e j\ ■ Taking 
again equally distributed d 2 letters with unitary single- 
site encoding given by the unitary operators W(l, k) <g> 1 
we reach the bound hid + S(p). 
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S(p[Y n }) = S(p[Y n ]) < (n+2l+l){S(p)+lnd) . (40) 



The proof of the upper bounds is completed by dividing 
both sides of (36) (37) (40) by n , taking limit n — > oo and 
proper suprema over Pi„,A and D. 

In the second part of the proof we show that the upper 
bounds are reached choosing proper Bernoulli sources, 
single-site encoding perturbations and suitable decoding 
observables. In this case Pi n (a) = p{ai)p(a2) ■ ■ -p(a n ) 
and p(a) — p(ai)p{ot2) ■ ■ ■ p(a n ) what is exactly the set- 
ting of the Holevo-Schumacher- Westmoreland theorem 
[13] which may be formulated as follows. 

Theorem 3 Take a Bernoulli source and a single-site 
encoding as above. Then, by a suitable choice of a de- 
coding observable the asymptotic amount of transmitted 
information per unit of time can be arbitrarily close to 
the Holevo-Levitin bound 

S(5>(a)p(a)) - 5>(a)£(p(a)) . (41) 

a a 

It remains to compute the bound (41) for different 
schemes corresponding to the capacities C°,C° and C% 
respectively. 

For C° we take d letters with a priori probabilities 1 jd 
and the single-site perturbations 



A^(er) = tr(er)|e a >< e a \ , a G M rf 



(42) 



where {|e Q >} is a basis for a single spin. The bound (41) 
is obviously equal to In d. 

For C° we take equally distributed d 2 letters with uni- 
tary single-site encoding given by the discrete Weyl op- 
erators W(l,k) (15). Then using the fact that for any 
single spin matrix a 



d 2 



W(k,l)aW(k,iy 



k,l=l 



tr(a)-l 



(43) 
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we obtain the bound (41) equal to In d — S(p). 

To reach the bound for we consider a purification 
of Bernoulli shift with a pure single-site reference state 
of spin - ancilla 
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